State constrained web browser navagition system providing a simple transaction configuration tool

ABSTRACT

A software product tests and monitors an Internet server system. Advantageously, the software product communicates with a web browser without the need for other client software to configure transactions. The user of the web browser is guided through web pages to record, edit, and playback transactions. Recording may occur over a secure connection. The software product performs automated tests using the transactions in addition to measuring both system performance data and business performance data. The software product generates alarms when thresholds are exceeded. The test data, performance data, and alarms are correlated in time and presented graphically to the user.

BACKGROUND OF THE INVENTION

[0001] Internet server systems are now a critical component to manysuccessful businesses. Many Internet server systems are configured tofunction as e-commerce web sites where computer users can purchase goodsand services. The efficient and reliable operation of the e-commerce website is vital to many businesses.

[0002] In response to the need for efficient and reliable e-commerce websites, test systems have been developed to ensure that the web site isoperating within tolerable thresholds. These test systems performautomated tests using transactions that were previously recorded. To theweb site, the test transaction appears like another customer. These testuser transactions are able to determine how long a typical transactiontakes and whether or not the e-commerce web site is responding at all.

[0003] Unfortunately, current test systems treat the Internet serversystem that provides the e-commerce web site as a black box—meaning thatthe test system sends in stimulus and measures response. Test systems donot effectively correlate user test results with internal performancemeasurements from the Internet server system. If there is a problem, thetest system does not effectively isolate the responsible componentwithin the Internet server system.

[0004] Current test systems also fail to correlate system testing andperformance data with business performance data. Business performancedata may only be produced in weekly or monthly reports. If the web siteoperator receives an alarm from a test system, another system must beused to assess the financial damage due to the system error. The use ofmultiple systems is complex and time consuming.

[0005] For effective testing, the test transactions must be properlyconfigured. As the web site changes, new features and equipment need newtest transactions for testing. In a typical sequence to configure atransaction, the user operates a web browser to interact with the website, and the web browser activity is recorded by a system in betweenthe web browser and the web site. The recorded activity forms the testtransaction that is saved for subsequent automated testing.

[0006] To put up a web site, the business often uses another entity toprovide the web site infrastructure, such as an Internet Serviceprovider (ISP), that owns and operates Internet server systems. Thebusiness must interact with the ISP to generate and implement new testtransactions. Often, the business receives some client software that itoperates with a web browser to generate and implement test transactionsthrough the ISP. Different versions of the client software must bedeveloped for the different web browsers, and possibly for the differentversions of the same web browser. Unfortunately, the client softwarealso requires the use of cookies or Java applets that can be too complexfor some business users—especially since the ISP is supposed to handlethe technical aspects of the web site. Cookies are files that aretransferred to the web browser for local storage and use by a webserver. Many people dislike storing cookies on their machines.

[0007] The cookies and Java applets are required when configuring atransaction to maintain the proper configuration sequence or state.Without proper management, a non-technical user may be easily lost in atransaction configuration sequence. The problem becomes acute when thenon-technical user begins to use forward and backward browser commandsduring a recording session.

[0008] Another problem during transaction recording occurs when secureInternet connections are invoked. Secure connections are often used forInternet commerce and need to be tested—especially their effects ontransaction time. Configuration tools between the web browser and theweb site that record web browser activity must decrypt the web browseractivity to record a secure transaction. Thus, the recording componentmust either have access to the security keys or must be integrated withthe web browser. Both of these techniques add too much complexity to theconfiguration tool.

SUMMARY

[0009] The invention solves the above problems with a software productfor testing and monitoring an Internet server system. Advantageously,the software product communicates with a web browser without the needfor other client software to configure transactions. The user of the webbrowser is guided through web pages to record, edit, and playbacktransactions. Recording may occur over a secure connection. The softwareproduct performs automated tests using the transactions in addition tomeasuring both system performance data and business performance data.The software product generates alarms when thresholds are exceeded. Thetest data, performance data, and alarms are correlated in time andpresented graphically to the user.

[0010] In one aspect of the invention, a user is guided through a seriesof steps required to configure a complex transaction.

DESCRIPTION OF THE DRAWINGS

[0011]FIG. 1 is a block diagram that illustrates Internet server systemtesting and monitoring in an example of the invention.

[0012]FIG. 2 is a chart diagram that illustrates Internet server systemtesting and monitoring in an example of the invention.

[0013]FIG. 3 is a block diagram that illustrates test instructions in anexample of the invention.

[0014]FIG. 4 is a block diagram that illustrates a web browser loginpage in an example of the invention.

[0015]FIG. 5 is a block diagram that illustrates a web browser selecttransaction page in an example of the invention.

[0016]FIG. 6 is a block diagram that illustrates a web browser recordtransaction page in an example of the invention.

[0017]FIG. 7 is a block diagram that illustrates a web browser edittransaction page in an example of the invention.

[0018]FIG. 8 is a block diagram that illustrates a web browser playtransaction page in an example of the invention.

[0019]FIG. 9 is a state diagram that illustrates transition state rulesfor web browser pages in an example of the invention.

[0020]FIG. 10 is a flow diagram that illustrates recording a transactionin an example of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0021] Internet Server System Testing and Monitoring—FIGS. 1-2

[0022] FIGS. 1-2 depict a specific example of Internet server systemtesting and monitoring in accord with the present invention. Thoseskilled in the art will appreciate numerous variations from this examplethat do not depart from the scope of the invention. Those skilled in theart will also appreciate that various features described below could becombined with other embodiments to form multiple variations of theinvention. Those skilled in the art will appreciate that someconventional aspects of FIGS. 1-2 have been simplified or omitted forclarity.

[0023]FIG. 1 is a block diagram that illustrates Internet server systemtesting and monitoring in an example of the invention. FIG. 1 includesInternet server system 100 and computer system 110 that have access tosoftware product 115. Internet server system 110 is coupled to Internetconnections 105 and includes web servers 101, session servers 102,transaction servers 103, and database servers 104. Web servers 101 useweb pages to interact with users over Internet connections 105. Sessionservers 102 track and respond to individual user activity by selectingweb pages with appropriate transaction data. Transaction servers supportsession servers 102 by exchanging transaction data. Database servers 104store transaction data.

[0024] Computer system 110 includes processor 111 that communicates witheach of web servers 101, session servers 102, transaction servers 103,and database servers 104 over link 106. Link 106 could be implementedwithin Internet connections 105. Computer system 110 tests and monitorsInternet server system 100 in response to processor 111 executing theinstructions of software product 115.

[0025] Software product 115 comprises software storage media 120 andsoftware storage media 130, and if desired, the two storage media couldbe integrated together. Software storage media 120 includes testinstructions 121, system performance instructions 122, and businessperformance instructions 123. Software storage media 130 includes agentinstructions 131. Some examples of software storage media 120 and 130are memory devices, tape, disks, integrated circuits, and servers.Processor 111 retrieves and executes test instructions 121, systemperformance instructions 122, and business performance instructions 123using software access link 112. Internet server system 100 retrieves andexecutes agent instructions 131 using software access link 132. Thoseskilled in the art appreciate that software access links 112 and 132 arelogical entities that represent various structures for providingsoftware access. For example, software product 115 could be downloadedfrom a server or transferred from a disk to a local memory device incomputer system 110 for subsequent retrieval and execution by processor111. The instructions 131 are operational when executed by Internetserver system 100 to direct Internet server system 100 to operate inaccord with the invention. Instructions 121-123 are operational whenexecuted by processor 111 to direct processor 111 to operate in accordwith the invention. The term “processor” refers to a single processingdevice or a group of inter-operational processing devices. Some examplesof processor 111 include computers, integrated circuits, and logiccircuitry. Those skilled in the art are familiar with instructions,processors, and storage media.

[0026] Test instructions 121 direct processor 111 to configure andexecute user transaction tests and report user transaction test results.User transaction tests emulate user activity to generate test resultssuch as transaction times and data transfer rates. System performanceinstructions 122 direct processor 111 to measure system performance datafor each of web servers 101, session servers 102, transaction servers103, and database servers 104. Examples of system performance datainclude processing capacity and data retrieval time. Businessperformance instructions 123 direct processor 111 to measure businessperformance data. Examples of business performance data include: 1)monetary volume transacted by Internet server system 100 during a timeperiod, 2) new orders transacted by Internet server system 100 during atime period, 3) sales volume for an item transacted by Internet serversystem 100 during a time period, 4) lost sales due to system errorsduring a time period, and 5) abandoned shopping carts during a timeperiod. Agent instructions 131 direct Internet server system 100 to readits log files to collect and transfer the system performance data andthe business performance data to processor 111.

[0027]FIG. 2 is a chart diagram that illustrates Internet server systemtesting and monitoring in an example of the invention. FIG. 2illustrates a chart that is generated by processor 111 and that could beincluded in a graphical display or report. The horizontal axisrepresents time of day and day of week. The vertical axis representsboth dollars per hour transacted at Internet server system 100 and theperformance of session servers 102 performance. Both are correlated intime along the horizontal axis. Performance could be processing load orsome other system performance metric. The solid lines represent actualsystem performance data and actual dollars per hour performance data.The lines for the actual performance data are bounded by upper and lowerthresholds that can be set by the user to trigger alarms. The lines forthe actual performance data have corresponding baselines which representaverages for the time of day and day of week that have been previouslycalculated. From the chart, one can readily deduce that poor sessionserver performance caused a serious loss in dollars per hour on Tuesdaymorning. Alarms were generated when the actual performance data fellbelow the lower thresholds. Alarms could trigger phone calls, e-mailsand pages to significant personnel who can quickly pull up the chartusing a remote terminal.

[0028] System performance instructions 122 and business performanceinstructions 123 direct processor 111 to correlate the systemperformance data and the business performance data in time. Systemperformance instructions 122 direct processor 111 to process the systemperformance data to generate system performance averages associated withtime of day and day of week. System performance instructions 122 directprocessor 111 to process the system performance data to generate systemalarms when a system performance threshold associated with time of dayand day of week is exceeded. System performance instructions 122 directprocessor 111 to process the system performance data to generate systemgraphics illustrating system performance measured against baselines andthresholds

[0029] Business performance instructions 123 direct processor 111 toprocess the business performance data to generate business performanceaverages associated with time of day and day of week. Businessperformance instructions 123 direct processor 111 to process thebusiness performance data to generate business alarms when a businessperformance threshold associated with time of day and day of week isexceeded. Business performance instructions 123 direct processor 111 toprocess the business performance data to generate business graphicsillustrating business performance measured against baselines andthresholds.

[0030] Test Instructions and Computer System Operation—FIGS. 3-10

[0031] FIGS. 3-10 depict a specific example of test instructions andcomputer system operation in accord with the present invention. Thoseskilled in the art will appreciate numerous variations from this examplethat do not depart from the scope of the invention. Those skilled in theart will also appreciate that various features described below could becombined with other embodiments to form multiple variations of theinvention. Those skilled in the art will appreciate that someconventional aspects of FIGS. 3-10 have been simplified or omitted forclarity.

[0032]FIG. 3 is a block diagram that illustrates test instructions 121in an example of the invention. FIG. 3 also shows user device 140 thatallows a user to operate web browser 141 to display web pages and inputdata. Web browser communicates with processor 111 over link 142.Typically, links 106 and 142 include a firewall to protect computersystem 110.

[0033] In response to processor 111 executing test instructions 121,computer system 110 operates to configure a transaction for the useroperating web browser 141. The transaction is used for automated testingof Internet server system 100. One example of a transaction is apurchase from Internet server system 100. Test instructions 121 includetransaction configuration instructions 150, page transition instructions151, proxy instructions 152, request instructions 153, and responseinstructions 154. Test instructions 121 direct processor 111 to: 1)interact with web browser 141 and Internet server system 100 to recordweb browser activity to generate the transaction, 2) edit thetransaction, 3) perform an automated test of Internet server system 100using the transaction to validate the transaction for subsequentautomated testing, 4) display test results from the automated test tothe user, 5) save the transaction for subsequent automated testing ofInternet server system, and 6) periodically perform automated tests ofInternet server system 100 using the transaction and report testresults. Transaction save operations should not require system restart.

[0034] Test instructions 121 may direct processor 111 to interact withweb browser 141 and Internet server system 100 through a firewall. Testinstructions 121 direct processor 111 to record the web browser activityto generate test measurements, such as the sequence of web pages. Testinstructions 121 direct processor 111 to add test measurements, such astransaction time and transaction data transfer rate, to the transaction.

[0035] Test instructions 121 can also direct processor 111 to record thebrowser activity as a series of steps and to edit the transaction tospecify test measurements for each step. Examples of test measurementsfor a step include elapsed time, a required string in an Internet serversystem response, and a prohibited string in an Internet server systemresponse. Test instructions 141 may also direct processor 111 to recordpauses for the steps and edit the transaction to redefine the pauses.

[0036] Test instructions 121 have the following test configuration andperformance features. They can handle HTTP frames, cookies, and secureconnections. They can parse pages for content and provide notificationif content changes are discovered. They can support nested transactions.They can specify ports for use by test performance systems. They canemulate user data input, such as data fills, check boxes, and buttonclicks. They can handle dynamic transaction updates, and they may bewritten in Java.

[0037] Transaction configuration instructions 150 direct processor 111to generate and transfer Hypertext Markup Language (HTML) pages withoutcookies to web browser 141. Advantageously, a standard web browser canbe used to remotely configure a complex test transaction without storingcookies or Java applets on user device 140. Transaction configurationinstructions 150 direct processor 111 to configure the transaction forautomated testing of Internet server system 100 in response to userinputs to the HTML pages. The HTML pages include a user login page, atransaction selection page, a transaction record page, a transactionedit page, and a transaction play page. The pages can be set-up usingdifferent languages.

[0038]FIG. 4 is a block diagram that illustrates web browser login page460 in an example of the invention. Page 460 includes data entry boxesfor user name and password that is verified by computer system 110 toauthorize the user. Page 460 includes logout and help buttons. Addresschecks may be used to provide additional security.

[0039]FIG. 5 is a block diagram that illustrates web browser selecttransaction page 560 in an example of the invention. Page 560 allows theuser to use web browser 141 to select a transaction. Page 560 includesnew transaction data entry boxes for transaction name, first transactionstep name, and a Uniform Resource Locator (URL) for the firsttransaction step. A record button corresponds to the new transactiondata. An existing transaction drop-down selection box corresponds tobuttons for edit, play, delete, rename, monitor, and un-monitor. Monitorinitiates periodic testing with the transaction, and un-monitor stopsperiodic testing with the transaction. Page 560 also includes logout andhelp buttons.

[0040]FIG. 6 is a block diagram that illustrates web browser recordtransaction page 660 in an example of the invention. Page 660 allows theuser to use web browser 141 to initiate a recording of web browseractivity to generate the transaction. Page 660 identifies thetransaction, the transaction step, the URL for the transaction step, anda pause for the URL. Page 660 displays the web page of the URL. Page 660has buttons for refresh, stop, insert step, and help.

[0041]FIG. 7 is a block diagram that illustrates web browser transactionedit page 760 in an example of the invention. Transaction edit page 760allows the user to use web browser 141 to edit the transaction generatedusing transaction record page 660. Transaction edit page 760 identifiesthe transaction and includes data entry boxes for the transaction steps,page titles for each step, URLs for each step, a pause for each URL, andtest conditions for each URL. Test conditions include must have stringsand fails with strings for each page. Test edit page 760 includesbuttons for record, play, stop, save, insert step, delete, and help. Acheck box for play with pauses is included. If desired, page 760 couldallow recorded user data inputs for each step to be viewed and edited.

[0042]FIG. 8 is a block diagram that illustrates web browser playtransaction page 860 in an example of the invention. Transaction playpage 860 allows the user to use web browser 141 to view results of anautomated test using the transaction generated using transaction recordpage 660 and edited using transaction edit page 760. Page 860 hasbuttons for refresh, stop, and help. Transaction play page 860identifies the transaction, the transaction steps, and test results foreach of the transaction steps. Test results include valid page content,test complete, and error messages. Valid page content is determined bysearching each page to find must have strings and determining an absenceof fails with strings.

[0043]FIG. 9 is a state diagram that illustrates transition state rules961 for web browser page transitions in an example of the invention.Page transition instructions 151 direct processor 111 to transitionbetween the pages in response to the user inputs and to constrain thetransition between the pages based on transition state rules 961.Transition state rules 961 constrain the transition between the pagesto: 1) transition from transaction selection page 560 to transactionrecord page 660 in response to a selection page record request, 2)transition from transaction record page 660 to transaction edit page 760in response to a record page stop request, 3) transition fromtransaction edit page 760 to transaction play page 860 in response to anedit page play request, 4) transition from transaction play page 860 totransaction edit page 760 in response to a play page stop request.Transition state rules 961 may also constrain the transition between thepages 460-860 to: 1) start at user login page 460 and transition totransaction selection page 560 in response to an authorized login, 2)transition from transaction selection page 560 to transaction edit page760 in response to a selection page edit request, 3) transition fromtransaction selection page 560 to transaction play page 860 in responseto a selection page play request, 4) transition from transaction editpage 760 to transaction record page 660 in response to an edit pagerecord request, 5) transition from transaction edit page 760 totransaction selection page 560 in response to an edit page stop request,6) transition from transaction selection page 560 to user login page 460in response to a selection page stop request, and 7) transition fromtransaction play page 860 to transaction selection page 560 in responseto a play page stop request and the transition from transactionselection page 560 to transaction play page 860.

[0044]FIG. 10 is a flow diagram that illustrates computer system 110operation when recording a transaction. Proxy instructions 152 directprocessor 111 to receive a first request from web browser 141, transferthe first request to the Internet, and receive a response to the firstrequest from the Internet. Response instructions 154 direct processor111 to search the response for a secure address, and if the responseincludes the secure address, then to replace the secure address with anon-secure address and identifying characters. Response instructions 154direct processor 111 to search the first response for embedded objects,and if the response includes any embedded objects, then to addcorresponding embedded object addresses to a list.

[0045] Proxy instructions 152 direct processor 111 to transfer theresponse to web browser 141 and receive a second request from webbrowser 141. Request instructions 153 direct processor 111 to record thesecond request as a new page if the second request is not for any of theembedded object addresses on the list. Request instructions 153 directprocessor 111 to clear the list if the second request is not for any ofthe embedded object addresses on the list. Request instructions 153direct processor 111 to replace the non-secure address and theidentifying characters with the secure address if the second request isfor the non-secure address and the identifying characters. Proxyinstructions 152 direct processor 111 to transfer the second request tothe Internet.

[0046] Typically, the requests comprise Hypertext Transfer Protocolrequests, the secure address and the non-secure address comprise URLs,and the response comprises a Hypertext Markup Language page. Typically,request instructions 153 direct processor 111 to record: 1) URLs for newpage requests, 2) the sequence of the new page requests, 3) elapsed timebetween new page requests, 4) user input within the new page requests.In some examples of the invention, response instructions 153 directprocessor 111 to search a header in the first response for a specialinstruction, and if the header includes the special instructions, thento record the special instruction.

[0047] Refer to Exhibits A, B, C, and D for additional informationregarding the invention. Those skilled in the art will appreciatevariations of the above-described embodiments that fall within the scopeof the invention. As a result, the invention is not limited to thespecific examples and illustrations discussed above, but only by thefollowing claims and their equivalents.

What is claimed is:
 1. A software product for a computer system toconfigure a transaction for a user operating a web browser wherein thetransaction is used for automated testing of an Internet server system,the software product comprising: test instructions configured direct aprocessor to interact with the web browser and the Internet serversystem to record web browser activity to generate the transaction, editthe transaction, perform an automated test of the Internet server systemusing the transaction, display test results to the user from theautomated test, and save the transaction for subsequent automatedtesting of the Internet server system; and a storage medium configuredto store the test instructions.
 2. The software product of claim 1wherein the test instructions are further configured to direct theprocessor to interact with the web browser and the Internet serversystem through a firewall.
 3. The software product of claim 1 whereinthe test instructions are further configured to direct the processor torecord the web browser activity to generate test measurements.
 4. Thesoftware product of claim 3 wherein one of the test measurements is asequence of web pages.
 5. The software product of claim 1 wherein thetest instructions are further configured to direct the processor to addtest measurements to the transaction including transaction time andtransaction data transfer rate.
 6. The software product of claim 1wherein the test instructions are further configured to direct theprocessor to record the browser activity as a series of steps and toedit the transaction to specify test measurements for each step.
 7. Thesoftware product of claim 6 wherein one of the test measurements foreach step is elapsed time.
 8. The software product of claim 6 whereinone of the test measurements for each step is a required string in anInternet server system response.
 9. The software product of claim 6wherein one of the test measurements for each step is a prohibitedstring in an Internet server system response.
 10. The software productof claim 6 wherein the test instructions are further configured todirect the processor to record pauses for the steps and edit thetransaction to redefine the pauses.
 11. A method of operating a computersystem to configure a transaction for a user operating a web browserwherein the transaction is used for automated testing of an Internetserver system, the method comprising: interacting with the web browserand the Internet server system to record web browser activity togenerate the transaction; interacting with the web browser to edit thetransaction; interacting with the Internet server system to perform anautomated test of the Internet server system using the transaction;interacting with the web browser to display test results to the userfrom the automated test; and saving the transaction for subsequentautomated testing of the Internet server system.
 12. The method of claim11 wherein interacting with the web browser and the Internet serversystem comprises interacting through a firewall.
 13. The method of claim11 further comprising recording the web browser activity to generatetest measurements.
 14. The method of claim 13 wherein one of the testmeasurements is a sequence of web pages.
 15. The method of claim 11further comprising adding test measurements to the transaction includingtransaction time and transaction data transfer rate.
 16. The method ofclaim 1 further comprising recording the browser activity as a series ofsteps and editing the transaction to specify test measurements for eachstep.
 17. The method of claim 16 wherein one of the test measurementsfor each step is elapsed time.
 18. The method of claim 16 wherein one ofthe test measurements for each step is a required string in an Internetserver system response.
 19. The method of claim 16 wherein one of thetest measurements for each step is a prohibited string in an Internetserver system response.
 20. The method of claim 16 further comprisingrecord pauses for the steps and editing the transaction to redefine thepauses.